Metastable states and space-time phase transitions in a spin-glass model 
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We study large deviations of the dynamical activity in the random orthogonal model (ROM). 
This is a fully connected spin-glass model with one-step replica symmetry breaking behaviour, 
consistent with the random first-order transition scenario for structural glasses. We show that 
this model displays dynamical (space-time) phase-transitions between active and inactive phases, 
as demonstrated by singularities in large deviation functions. We argue that such transitions are 
generic in systems with long-lived metastable states. 
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Glass transitions and glassy dynamics occur in a wide 
range of systems, including structural glasses [![, colloidal 
suspensions, granular media 0] and spin glasses As 
their glass transitions are approached, the relaxation in 
these systems slows down dramatically but their struc- 
ture remains disordered. The increasing relaxation time 
is often assumed to be a consequence of an underlying 
(continuous) phase transition @, d, Q , but the existence 
of such a transition in structural glasses remains un- 
proven. 

We and others have recently proposed that, even if 
no thermodynamic phase transition exists in glass for- 
mers, the underlying transition might be a (discontin- 
uous) "space-time" phase transition @, H, Q, occur- 
ring in trajectory space. By applying a thermodynamic 
(large d eviation) formalism to ensembles of trajectories 
jlfj . 1 1 11 ] , one constructs dynamical frcc-cncrgics, whose 
singularities can be interpreted as dynamical phase tran- 
sitions. The existence of such first-order transitions can 
be proven in idealised lattice models, known as kinetically 
constrained models (KCMs) Furthermore, computer 
simulations reveal behaviour consistent with these phase 
transitions in atomistic model glass-formers 0. Phys- 
ically, the idea is that the characteristic features of 
glassy systems arise from coexistence between active and 
inactive dynamical phases. 

Here, we consider the random orthogonal model 
(ROM) [UGl], a fully-connected spin-glass model that 
realises the one-step replica symmetry breaking (1-RSB) 
scenario. This scenario is the basis for a mean-field the- 
ory of structural glasses, the random first-order transi- 
tion theory We show that the ROM supports coex- 
isting dynamical phases, separated by first-order space- 
time phase transitions, as in KCMs. We argue that these 
transitions occur in systems with long-lived metastable 
states, including generic 1-RSB models. 

We apply thermodynamic methods to measures of dy- 
namical activity, as described in Q. Consider a system 
of N spins (or N particles) , evolving with stochastic dy- 
namics, at temperature T. We define 
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FIG. 1: Space-time phase transition in the ROM. 

(a) Average activity k(s) as a function of s for A = 64 and 
fixed disorder at T = 1/5 > Td. The equilibrium relaxation 
time at this temperature is r ~ 110 (in units of MC sweeps). 
The crossover in k(s) becomes increasingly sharp as f b s in- 
creases. The inset to (a) shows k(s) for five different disorder 
realisations for t ^ s — 16000. (b) Dependence of s* and x* 
(inset) on observation time and system size. This scaling 
compatible with a space-time phase transition at s — 0. 



where K is a measure of activity and the average is taken 
over trajectories that run from an initial time t — 
to a final time t = i b s , in an equilibrated system. In 
the ROM, the configuration space is discrete and we 
take K to be the number of changes of configuration 
(kinks) in the trajectory 0, 0. For large £ b s , then 
Z(s,t hs) ~ e tohe ^^. The function tp(s) is a large devi- 
ation function, and can be thought of as a "space-time" 
free energy. Rs singularities are space-time phase tran- 
sitions: i.e., qualitative changes in ensembles of trajec- 
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FIG. 2: Dynamics in active and inactive phases. Au- 
tocorrelation functions C a (t) in the ROM at T = 1/5, for 
N = 64 and t bs = 16000, illustrating active and inactive 
phases obtained by varying s. 



tories. Interpreting Z(s,t bs) as the partition function 
for a biased ensemble of trajectories (the 's-enscmblc'), 
we define expectation values within this ensemble as 
(A) s = Z(s,t ohs )~ 1 (Ae~ sK ) tobB . In particular, 
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is the mean activity in the s-ensemble. In the limit of 
large i b s then k(s) — > —j^tp'(s). (The ensemble with 
s = is simply the equilibrium ensemble of trajectories.) 

The random orthogonal model (ROM) [l2[ consists of 
.ZV Ising spins Oj = ±1 (i = 1, . . . , N) and an energy func- 
tion E = 1/2 JijCi&j- The matrix of quenched ran- 
dom couplings Jij is symmetric and orthogonal. We con- 
struct it as J = R T DR where D — diag(l, —1, 1, —1, . . .) 
and R is a randomly generated O(N) rotation. Consis- 
tent with the 1-RSB scenario in the N oo limit, there 
are three important temperatures for the ROM [12| : the 
static transition temperature Tk = 0.065 below which 
replica symmetry is broken; the dynamical transition 
temperature Td = 0.134 below which the equilibrium 
correlation function has a non-zero limit as t — > oo; 
and the onset temperature T Q = 0.32 below which 
long-lived Thouless- Anderson-Palmer (TAP) states ex- 
ist 



The ROM is straightforwardly simulated using Monte 
Carlo dynamics. Time is measured in Monte Carlo 
sweeps throughout, and the only parameter of the model 
is the temperature T. We focus first on the regime 
Td < T < T Q which is the most relevant one for su- 
percooled liquids. We use transition path sampling [l8[ 
to sample the s-ensemble, as described in Q. We show 
results for N > 64 and for representative realisations of 
the disorder Jy . Our results depend weakly on the reali- 
sation of the disorder, but we have not analysed samplc- 
to-samplc fluctuations in detail due the computational 
effort associated with sampling the s-ensemble (see [l~3| 
for an analysis at equilibrium). 

Fig. H{a) shows the mean activity k(s) in the s- 



cnscmble at temperature T = 1/5. Clearly, k(s) de- 
creases sharply as s is increased from zero. That is, there 
is a crossover from active behaviour for s < to inactive 
behaviour for larger s, and this crossover becomes in- 
creasingly sharp as N and t b s are increased. The inset 
to Fig. QJa) suggests that this crossover is independent 
of the precise realisation of the disorder Jy. The sus- 
ceptibility x( s ) = fc'( s ) peaks at the inflection point of 
the curves in panel (a). Let s* be the value of s that 
maximises \, and let x* = x( s *) be the maximal suscep- 
tibility. Fig. [2(b) shows that s* decreases towards zero 
with increasing A~ and i bs, and x* diverges linearly with 
the space-time volume A" x i b s . This finite size scal- 
ing is consistent with a sharp (first-order) transition at 
s* = 0. We interpret s = as a line of 'dynamical phase 
coexistence' @. 

We note that the s-ensemble is time-translational in- 
variant (TTI) only for times <C t <C i bs, with devi- 
ations from TTI behaviour Q near the initial and final 
times. These boundary effects enhance the contribution 
of the active phase to Z(s,t hs), so that for fixed N we 
expect [12] that s* = % + 0(l/t o bs)) consistent with 
Fig. [2(b). The scaling of x* and s* with A^ can be ac- 
counted for by considering the lifetimes of metastable 
(TAP) states in finite systems. Briefly, if Af is finite then 
all metastable states have finite lifetimes and ip(s) is an- 
alytic for all s flij . 

We characterise the dynamical behaviour of the ROM 
in the s-ensemble via the autocorrelation function, 
C s {t) = {N" 1 J2 t Vi{t' + t)vi(t')) s , which is independent 
of t' for < t' < t + t' < t obs Fig. [2] shows this 
function for values of s on both sides of the dynamical 
transition. We have T > Td, so the equilibrium dynam- 
ics of the ROM are ergodic, and C s =o(t) decays to zero 
with a finite relaxation time r. For s < 0, states with 
high activity dominate the s-ensemble and the trajecto- 
ries resemble those at equilibrium. However, for s > 0, 
states with low activity predominate, and Fig. [2] shows 
that C s (t) remains finite on the longest time scales that 
we can sample. Wc define <7ea = lmit^oo C s (t), with 
the limit taken after the limits of large N and t b s . We 
now show that systems realising the 1-RSB scenario have 
a first-order dynamical transition from a 'paramagnetic 
state' with gEA = to a 'spin glass' with finite <7ea, as s 
is increased through zero. This is consistent with Figs. Q] 
and[U since the ROM realises this scenario. 

Our discussion rests on the existence of a large num- 
ber of metastable states, which can be studied within the 



TAP approach [HEEGzl. Thc presence of TAP states 
is sufficient to prove the existence of a space-time phase 
transition. Let W be the master operator associated with 
the stochastic dynamics of the system, as in Q. Consis- 
tent with the 1-RSB scenario, we assume a separation 
of time scales, corresponding to conditions on the eigen- 
spectrum of W: There is a spectrum of fast rates larger 
than some cutoff 7f and a spectrum of slow rates smaller 
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than a second cutoff 7 S <C 7f . On starting in a given con- 
figuration, the system relaxes quickly into a metastable 
(TAP) state in a time of order 7 f _1 . However, transitions 
between these states occur much more slowly, taking a 
time of order 7 S _1 . Then, for 7^ <C i Q b s <C 7T 1 , the time 
evolution operator of the system is a projection operator 
onto the TAP states: 



Y,\ p a )(Q a \ + o(c 



7f*ob,'\ 



0(7sU s ), (3) 




where \P a ) describes the (metastable) equilibrium distri- 
bution within state a, and (Q a \ gives the probabilities of 
relaxation into state a [2(| . This result was used in 17 1 , 
where the trace of e wt was used to estimate the number 
of metastable states with lifetimes greater than t*. 

Now, the partition sum Z(s,t a \ )s ) has a transfer ma- 
trix representation and the free energy ip(s)js the largest 
eigenvalue of a transfer operator W(s) [lj, |21|, such 
that W(0) = W. Further, the largest eigenvalue of 
W(s) can be estimated variationally [8|, so that i/j(s) > 

/e^v!^ for any trial state I*), with E being the 
energy operator of the system (we take fee = 1). For 
small s, we use the variational basis \P a ), arriving at 



i>{s) > ^ V ar(s) = -Amin[sfc Q ] + 0(7 8 ) + 0(s 2 ) 



(4) 



where k a is the average value of the activity density 
K/(Nt bs) for trajectories at (metastable) equilibrium in 
state a. For 7 S <C \s\ <C 7f, the bound is saturated [22| . 
and 
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FIG. 3: Transitions in the ROM for T > T D and T < T d . 

(a) Mean activity fc(s) as a function of s at T = 1/2 > T for 
increasing t D b s at AT = 64 and fixed disorder, cf. Fig. [TJ The 
equilibrium correlation time at this temperature is r ~ 4. In- 
set: effect on s* of increasing iV and t b s - These observations 
are consistent with a transition at finite s* in the thermo- 
dynamic limit. [On increasing t b s at N = 64, x*/(-^°bs) 
increases weakly (not shown).] (b) Mean activity k(s) at 
T = 1/9 < T d for N = 64. The behaviour of k(s) is consistent 
with a hrst-order transition at s* = 0. Inset: autocorrelation 
C s (t) for fobs = 3 x 10 4 for various s. The relaxation time at 
s = is r fts 10 7 , although this depends strongly on system 
size since T < Td. 



where 9(s) is the step function. In the 1-RSB scenario, 
the slow rate 7 S vanishes in the limit of large- N. Taking 
this limit, followed by a limit of large t h s , Eq. © holds 
as \s\ — > 0. Hence, if the states a cover a finite range of 
k a then k(s) is discontinuous at s = 0. Thus, if 7f is finite 
and 7 S — > 0, there is a first-order dynamical transition at 
s = 0, similar to that seen in KCMs 0. The prediction 
of Eq. (jSJ) and the numerical observations of Figs. Q] and [2] 
constitute the key results of this paper: for Td < T < T Q , 
the ROM has a first-order space-time phase transition at 
s = 0. 

In thermodynamics, first-order phase transitions are 
characterised by singular responses to boundary fields. 
We take s = and Td < T < T a , and consider an ensem- 
ble of trajectories with initial conditions that are equili- 
brated at temperature T 1 . Within the 1-RSB scenario, 
the system relaxes into the equilibrium (active) state for 
T' > Td, but for T' < Td it relaxes into a metastable state 
with finite qEA [3- In the language of the s-ensemble, 
the temperature T' corresponds to a boundary field on 
the trajectories, and the singular response at T' = Td 
may be linked with wetting phenomena [23[ . 



So far we have considered only Td < T < T a . For 
temperatures above the onset temperature, T > T Q , 
metastable states are no longer infinitely long-lived and 
the slow rate 7 S remains finite even as — ► 00. It fol- 
lows that k(s) is continuous at s = 0. In the absence of 
a diverging slow time scale associated with the operator 
W, one might expect k(s) to be analytic for all s [l9| . 
However, for T > T Q , analytic arguments 22| and nu- 
merical results both indicate a first-order dynamic phase 
transition between active and inactive phases that occurs 
at finite s* . Fig. [3Ja) shows the numerical evidence for 
this transition. Dynamical phase transitions at finite s 
have been found in other spin models for which all states 
have finite lifetimes [3, 0] . 

For T < Td, the behaviour is subtle and we postpone a 
detailed discussion to later work In this regime, 1- 
RSB systems have 'threshold' states which are associated 
with aging behaviour pEj ]. The relaxation time within 
the paramagnetic state diverges, and the 'gap' (jf — %) 
vanishes. We evaluate the bound in Eq. ([?]) while exclud- 
ing the paramagnetic state from the minimisation. The 
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FIG. 4: Proposed space-time phase diagram. The heavy 
line is a first-order transition between active and inactive dy- 
namical phases. We expect dynamical phase coexistence at 
s = in 1-RSB systems for all temperatures below the on- 
set temperature T . For T > T coexistence takes place at 
s > 0. The dashed line separates the metastable active state 
of Fig. EJb) from the paramagnetic active state of Fig. [T] 



resulting bounds may not be saturated so the proof of 
Eq. © fails. However, as long as the minimisation con- 
tains states with a finite range of k a , Eq. (H} establishes 
the existence of a first-order space-time phase transition 
for T <T d , similar to that for T > T d . Fig. g^b) shows 
numerical results consistent with such a transition. Note 
that qea remains finite for s < 0, suggesting that the 
active state is constructed from active metastable states 
and not from paramagnetic 'threshold' states. 

The dynamical phase structure of the ROM is sum- 
marised in the (s,T) phase diagram of Fig. [4] For tem- 
peratures between the dynamical transition temperature 
and the onset of metastability, Td < T < T D , metastable 
states lead to a first-order dynamical phase transition at 
s = (Fig. [TJ. Thus, the equilibrium ensemble of tra- 
jectories is associated with coexistence between active 
(crgodic) and inactive phases. Above T a , all metastable 
states in the model have finite lifetimes, and the coex- 
istence line moves to finite s, Fig. |3Ja). For T < T d , 
the first-order transition remains at s — but it now 
separates dynamics within metastable states with high 
and low activity, Fig. [3(b) . This suggests that for s < 
there is a transition near Td between an active ergodic 
phase with (?ea = and an active but non-ergodic phase 
in which the activity k(s) is larger than its equilibrium 
value fc(0) but (?ea > [24]]. At Tk the system undergoes 
an 'entropy crisis': for T < Tk, the TAP states are nu- 
merous although their associated entropy (complexity) 
vanishes. Nevertheless, our arguments for T < T d still 
apply, indicating that the transition remains at s = 0. 

We have focussed on the ROM in this article, but 
Eqs. (|4]) and ((SJ) indicate that phase diagrams for generic 
1-RSB systems should be similar to Fig. [4] How this 
picture differs between mean-field and finite-dimensional 
systems is an important open question. Our main conclu- 
sion is that dynamical phase coexistence between active 
and inactive phases is not restricted to idealised KCMs [8] 



but also present in atomistic liquids [9], and, as we have 
shown here, in spin-glasses. The s-ensemble is the nat- 
ural method for studying inactive and metastable states 
and their consequences in glassy systems in general. 
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